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BACKGROUND 

20 Field of the Invention 

The present invention relates to computer systems and data transmissions. 
More specifically, the present invention relates to a method and an apparatus for 
receiving multiple streams of packets that are interleaved together into a single 
stream through a circular buffer. 

25 

Related Art 

Internet users are presently demanding more bandwidth than can be 
provided with a conventional modem connection through a telephone line. The 
56K data transfer rate provided by a conventional modem connection is not 
30 sufficient to rapidly transfer graphical images that are commonly incorporated into 
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web sites. Hence, people browsing through web pages within websites are 
continually waiting for images to load. Furthermore, other data-intensive 
services, such as high quality streaming video, are essentially impossible to 
provide through a 56K modem connection, 

5 People are presently developing a number of alternatives to the standard 

56K modem. DSL modems can provide high data transfer rates through existing 
telephone lines, but they require expensive modifications to the switching 
equipment inside telephone company central offices. Hence, DSL technology 
cannot be used without a major investment by the local telephone system, and 

1 0 some local telephone systems have been hesitant to make such an investment. 

Furthermore, in many cases a DSL modem cannot achieve a high data transfer rate 
if the telephone line to the telephone system central office is too long, or if the 
telephone line has poor quality wiring. 

Cable modems can also provide high data transfer rates, but providing 

1 5 modem access through a cable network requires a significant investment in new 
equipment by a local cable company, and some local cable companies have been 
hesitant to make such an investment. Furthermore, some regions are not yet wired 
for cable. 

Another option is to use satellite communications channels to provide high 
20 data transfer rates. Unlike DSL modems or cable modems, satellite 

communication channels are not under the control of local utility providers. 

However, using satellite communication channels poses other challenges. 
In order for satellite-based systems to be successful, low-cost, high-performance 
receiving stations must be developed to receive the satellite transmissions. More 
25 specifically, a system must be developed to convert a stream of transport packets, 
such as a Motion Picture Experts Group (MPEG) 2 transport stream, into a form 
that is suitable for transmission over a local computer network, such as IP packets. 
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One challenge in developing such a system is to minimize the amount of 
circuitry required to convert transport packets into IP packets, and to thereby 
minimize the total cost of the satellite receiving system. One way to reduce the 
amount of circuitry is to use special-purpose hardware to perform the conversion 

5 instead of using a larger general-purpose microprocessor. 

The amount of circuitry can be further reduced by minimizing the amount 
of memory required to reconstruct the IP packets. This memory reduction is 
complicated by the fact that the stream of transport packets may include multiple 
streams of IP packets that are interleaved together into the single stream of 

10 transport packets. Hence, multiple IP packets from different streams may have to 
be assembled at the same time. This can be accomplished by maintaining a 
separate queue for each stream of IP packets. However, maintaining separate 
queues can consume a great deal of memory, because each queue has to be large 
enough to accommodate a worst case demand for the associated stream, and there 

1 5 can be many streams. 

What is needed is a method and an apparatus for reducing the amount of 
memory required to reconstruct multiple streams of IP packets from a single 
interleaved stream of transport packets. 



20 SUMMARY 

One embodiment of the present invention provides a system that 
reassembles multiple streams of Internet Protocol (IP) packets that have been 
converted into a single interleaved stream of transport protocol packets. Upon 
receiving the stream of the transport packets, the system reassembles the IP 
25 packets within a single IP packet buffer. At the same time, the system keeps track 
of the order in which reassembly is completed for the IP packets. This enables the 
system to read the IP packets out of the single IP packet buffer in the order in 
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which reassembly is completed before forwarding the reassembled IP packets to 
destinations specified by IP addresses contained in the IP packets. Note that 
reading the IP packets out of the IP packet buffer in this order can minimize the 
latency for individual streams of IP packets because a given IP packet that is 
5 completed first does not have to wait for a previously started IP packet that has 
not been completed. Furthermore, using a single buffer for reassembling the 
multiple streams of IP packets greatly reduces the amount of memory required to 
assemble the IP packets. 

In one embodiment of the present invention, keeping track of the order in 
10 which reassembly is completed involves maintaining a circular buffer containing 
pointers to completed IP packets within the single IP packet buffer. In this 
embodiment, a pointer to a completed IP packet is entered into the circular buffer 
upon completion of the IP packet. 

In one embodiment of the present invention, reading the IP packets out of 
1 5 the single IP packet buffer involves advancing a buffer pointer around the circular 
buffer containing pointers to completed IP packets. The system then reads the 
completed IP packets through pointers that are pointed to by the buffer pointer, so 
that the completed IP packets are read out of the single IP packet buffer in the 
order in which they were completed. 
20 In one embodiment of the present invention, the single IP packet buffer is 

organized as a circular buffer, wherein buffers for incoming IP packets are 
appended to the end of the circular buffer. 

In one embodiment of the present invention, reassembling the IP packets 
from the transport packets involves maintaining a write pointer into the single IP 
25 packet buffer for each stream of IP packets, wherein each write pointer points to a 
packet being reassembled for an associated stream of IP packets. In a variation on 
this embodiment, each write pointer includes a start pointer that points to the start 
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of a packet being received for the associated stream within the single IP packet 
buffer. It also includes a number of bytes received so far for the packet being 
received, and logic that calculates the write pointer from the start pointer and the 
number of bytes received so far. 
5 In one embodiment of the present invention, upon receiving a single 

transport packet that includes an end section of a first IP packet and a beginning 
section of a second IP packet, the system directs the end section of the first IP 
packet to a first location in the single IP packet buffer wherein the first IP packet 
is being reassembled. The system also directs the beginning section of the second 

1 0 IP packet to a second location in the single IP packet buffer where the second IP 
packet is being reassembled. 

In one embodiment of the present invention, the single stream of transport 
packets includes MPEG2 transport packets. 

In one embodiment of the present invention, reassembling IP packets 

1 5 involves filtering transport packets based upon packet identifiers (PIDs) to filter 
out transport packets containing data that is not of a specified type for the IP 
packets. 

In one embodiment of the present invention, reassembling IP packets 
involves checking continuity for transport packets to ensure that all transport 
20 packets that make up an IP packet are received in sequential order. 

In one embodiment of the present invention, the system additionally filters 
the IP packets based upon media access control (MAC) addresses to filter out IP 
packets that are not directed to an IP destination address on a local network. 

In one embodiment of the present invention, the single stream of transport 
25 packets is received from a satellite. 
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BRIEF DESCRIPTION OF THE FIGURES 

FIG. 1 illustrates a system for communicating a data stream from a 
satellite to a computer network in accordance with an embodiment of the present 
invention. 

FIG. 2 illustrates the internal structure of an interface module that converts 
satellite transmissions into IP packets in accordance with an embodiment of the 
present invention. 

FIG. 3 illustrates the internal structure of a multi-IP receiver in accordance 
with an embodiment of the present invention. 

FIG. 4 illustrates how multiple streams of IP packets are converted into 
transport packets and interleaved together. 

FIG. 5 illustrates data storage elements involved in the packet 
reconstruction process in accordance with an embodiment of the present 
invention. 

FIG. 6 illustrates operation of the circular buffer for IP packets in 
accordance with an embodiment of the present invention. 

FIG. 7 is a flow chart illustrating the process of reconstructing IP packets 
from transport packets in accordance with an embodiment of the present 
invention. 

FIG. 8 is a flow chart illustrating the process of reading IP packets from 
the IP packet buffer in accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION 

The following description is presented to enable any person skilled in the 
art to make and use the invention, and is provided in the context of a particular 
application and its requirements. Various modifications to the disclosed 
embodiments will be readily apparent to those skilled in the art, and the general 
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principles defined herein may be applied to other embodiments and applications 
without departing from the spirit and scope of the present invention. Thus, the 
present invention is not intended to be limited to the embodiments shown, but is 
to be accorded the widest scope consistent with the principles and features 

5 disclosed herein. 

The data structures and code described in this detailed description are 
typically stored on a computer readable storage medium, which may be any device 
or medium that can store code and/or data for use by a computer system. This 
includes, but is not limited to, magnetic and optical storage devices such as disk 

1 0 drives, magnetic tape, CDs (compact discs) and DVDs (digital versatile discs or 
digital video discs), and computer instruction signals embodied in a transmission 
medium (with or without a carrier wave upon which the signals are modulated). 
For example, the transmission medium may include a communications network, 
such as the Internet. 

15 

Communication System 

FIG. 1 illustrates a system for communicating a data stream from a 
satellite 101 to a network 120 in accordance with an embodiment of the present 
invention. Satellite 101 can include any type of broadcast satellite or 

20 communication satellite that is capable of sending a transport stream, such as a 
digital MPEG2 transport stream. Server 118 transmits a signal 1 19 to satellite 
101. Server 1 18 can include any computational node including a mechanism for 
servicing requests from a client for computational or data storage resources. In 
one embodiment, server 1 18 is a web server that hosts a web site. Not shown in 

25 FIG. 1 is the circuitry for converting an output from server 1 1 8 into a signal 1 1 9 
suitable for transmission to satellite 101 . Signal 1 19 is forwarded from satellite 
101 to satellite dish 105, which is coupled with interface module 103. 
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Interface module 103 converts the signal from satellite 101 into a digital 
form that can be manipulated by the computer system. Interface module 1 03 
produces two different types of output. The first output is a Peripheral 
Component Interface (PCI) output 107, which enables interface module 103 to 
5 communicate directly with a computer system through a PCI bus. The second 
output is universal serial bus (USB) output 104, which provides a serial interface 
between interface module 103 and PC/router 108. PC/router 108 can include any 
type of system, such as a personal computer, a hub or a router, that can be used to 
facilitate communications across a network. 

10 In FIG. 1, PC/router 108 is coupled to clients 122-123 through network 

120. Network 120 can include any type of wire or wireless communication 
channel capable of coupling together computing nodes. This includes, but is not 
limited to, a local area network, a wide area network, or a combination of 
networks. In one embodiment of the present invention, network 120 includes the 

15 Internet. In the embodiment illustrated in FIG. 1, network 120 is a local area 
network. Clients 122 and 123 can include any node on network 120 including 
computational capability and including a mechanism for communicating across 
network 120, 

PC/router 108 is also coupled to modem 109, which provides a low-to- 
20 mid-bandwidth communication path to server 118. More specifically, PC/router 
108 communicates with network service provider 114 through modem 109 and 
telephone line 112, Network service provider 1 14 communicates with server 118 
through network 120. Network service provider 1 14 can include any type of 
mechanism for linking modem 109 with network 116 through telephone line 1 12. 
25 Note that instead of using modem 109 and telephone line 1 12, the system can 
alternatively use any other type of communication pathway to server 118. For 
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example, the system can use an ISDN linkage, a DSL linkage, a wireless 
communication channel, or a satellite communication channel. 

Network 116 can include any type of wire or wireless communication 
channel capable of coupling together computing nodes. This includes, but is not 
5 limited to, a local area network, a wide area network, or a combination of 
networks. In one embodiment, network 1 16 includes the Internet. In one 
embodiment, network 116 and network 120 are the same network. 

The system illustrated in FIG. 1 operates generally as follows. Clients 
122-123 communicate with server 118 through a high-bandwidth pathway through 

10 satellite 101 and a low-to-mid-bandwidth pathway through modem 109. The 
high-bandwidth pathway is used to transfer data, such as graphical images from 
server 1 18 to clients 122-123. The low- to-mid-bandwidth pathway is used to 
transfer commands and other input from clients 122-123 to server 118. This type 
of asymmetric arrangement is well-suited for applications such as web sites that 

1 5 send large volumes of data (such as graphical images) to clients, and yet receive 
only a small amount of data from the clients. 

Using the high-bandwidth pathway, server 118 sends signal 1 19 through 
satellite 101 into interface module 103. Interface module 103 converts this signal 
into IP packets within USB frames and sends the USB frames to PC/router 108. 

20 PC/router 108 extracts the IP packets from the USB frames and sends the IP 
packets across network 120 to clients 122-123. 

Using the low-to-mid-bandwidth pathway, clients 122-123 send data 
across network 120 to PC/router 108. PC/router 108 forwards the data to network 
service provider 114 through modem 109. Network service provider 1 14 

25 forwards the data across network 1 16 to server 118. 
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Interface Module 

FIG. 2 illustrates the internal structure of an interface module 103 that 
converts satellite transmissions into IP packets in accordance with an embodiment 
of the present invention. Interface module 103 includes tuner 202 and 
5 demodulator 204. Tuner 202 can include any type of circuit that can be tuned to 
receive signals from a satellite (or any other high-bandwidth MPEG2 data stream). 
Demodulator 204 can include any type of circuit that can demodulate signals 
received from a satellite through tuner 202. Demodulator 204 converts the signal 
received from satellite 101 into a digital form, which is transferred across data 
1 0 lines 2 1 5 and control lines 2 1 7 into transport interface 210. 

Transport interface 210 includes circuitry for receiving data lines 215 and 
control lines 217. Note that control lines 217 include incoming clock signal 219, 
which is part of the transport stream. In one embodiment of the present invention, 
transport interface 210 is an MPEG2 transport interface for receiving MPEG2 
15 transport signals. 

Transport interface 210 forwards signals through multi-IP stream receiver 
213. Multi-IP stream receiver 213 contains circuitry that filters transport packets 
based upon packet type as specified in a packet identifier (PID). Some packets, 
such as NULL packets, are discarded by a PID filter 302 within multi-IP stream 
20 receiver 2 1 3 (see FIG. 3). Other packets are routed in different directions. For 
example, transport packets containing audio and video data are routed directly 
into memory 218. Transport packets containing tabular data are routed through 
table translator 214 to produce tables, such as table 225 within memory 218. 
Transport packets containing IP packets are routed through transport-to-IP 
25 converter 306 within multi-IP stream receiver 213 (see FIG. 3), which converts 
transport packets into IP packets and stores the IP packets into IP buffer 223 for 
reassembling packets 220-222 within memory 218. 
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Next, IP packets 220-222 are retrieved by USB interface 230 and are 
forwarded through USB output 104. Note that USB interface 230 operates under 
control of interface module clock signal 221, which is locally generated within 
interface module 103 by clock generator 232. Hence, USB interface 230 operates 

5 within the clock domain 252 of interface module clock signal 221 . 

In contrast, components that write IP packets into IP buffer 223, including 
transport interface 210, transport-to-IP converter 306, PID filter 302 and table 
translator 214, all operate under control of incoming clock signal 219, which is 
received from demodulator 204 along with the transport stream. Hence, transport 

10 interface 210, transport-to-IP converter 306, PID filter 302 and table translator 
214 all operate within incoming clock signal domain 250. 

Note that interface module 103 does not include a general-purpose 
microprocessor for converting transport packets into IP packets, but instead 
includes special-purpose hardware, including state machines, to perform the 

1 5 conversion. Using special-purpose hardware requires far less circuitry and 
resources than using a general-purpose microprocessor. 

Multi-IP Receiver 

FIG. 3 illustrates the internal structure of multi-IP stream receiver 213 in 
20 accordance with an embodiment of the present invention. As mentioned above 
with reference to FIG. 2, multi-IP stream receiver 213 includes PID filter 302, 
which filters transport packets based upon packet type, as well as transport-to-IP 
converter 306, which converts transport packets into IP packets. 

Multi-IP stream receiver 213 also includes media access control (MAC) 
25 filter 304, which is configured to filter IP packets based upon MAC addresses in 
order to filter out IP packets that are not directed to an IP destination address on 
local network 120. 
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Multi-IP stream receiver 213 additionally includes state sever 308, which 
saves the state of current packet translations for each PID in the interleaved 
transport stream. For example, state saver 308 includes PID state 310, PID state 
311 and PID state 3 12 for each different PID that may be included in the 
5 interleaved transport stream from transport interface 210. 



Interleaving of Transport Packets 

FIG. 4 illustrates how multiple streams of IP packets are converted into 
transport packets and interleaved together to form transport stream 404, which is 

1 0 received from satellite 101. 

As illustrated in the top portion of FIG. 4, a number of different streams 
ST1, ST2, ST3, . . . , STN, which are associated with MAC addresses Ml, M2, 
M3 ? ... 9 MN, are converted into PID steams, which are then converted into 
transport packets. Note that multiple MAC address streams may be associated 

1 5 with a single PID stream. For example, both stream ST1 and STN are associated 
with PID 100. Hence, the stream for PID 100 includes IP packets from both ST1 
and STN. (See the middle section of FIG. 4 which illustrates a packet for ST1 
containing IP 1.1, followed by a packet for STN, containing IPN.l, followed by a 
packet for STN, containing IPN.2.) 

20 Each PID stream is divided into transport packets, and these transport 

packets from the individual PID streams are interleaved together to produce the 
single transport stream. For example, in the bottom portion of FIG. 4 packet IP 1 . 1 
is divided into transport packets 405 and 406; packet IPN. 1 is divided into 
transport packets 408 and 409; packet IP 1.2 is divided into transport packets 409, 

25 411 and 412; and packet IP2.1 is divided into transport packets 407 and 410, 
Note that the end portion of packet IPN1 and the beginning portion of 
packet IP2, 1 are contained within the same transport packet 409. This is called 
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"section packing". Also note that transport-to-IP converter 306 performs the 
reverse operation, which is known as "section unpacking". 

In the example illustrated in FIG. 4, transport packets from PID stream 
102 are interleaved within transport packets from PID stream 100. Transport-to- 
5 IP converter 306 undoes this interleaving in order to reconstruct the IP packets. 

Data Storage Elements 

FIG. 5 illustrates data storage elements involved in the packet 
reconstruction process in accordance with an embodiment of the present 
1 0 invention. These data storage elements include IP buffer 223, complete IP packet 
pointers 540 and working pointers 550. 

IP buffer 223 is organized as a circular buffer with a read current (RC) 
pointer 530, a write current (WC) 53 1 and a write future (WF) pointer 532. The 
operation of these pointers is described in more detail with reference to FIG. 6 
1 5 below. 

IP packets from multiple streams are reassembled within IP buffer 223. 
For example, IP packet 510 for PID 100 is being reassembled at the same time as 
IP packet 520 for PID 102 is being reassembled. Note that IP packet 510 includes 
a status indicator 5 1 1 as well as a packet size 512. Status indicator 5 1 1 can be in 

20 one of three states, "working", "complete", or "done". "Working" indicates that 
the packet is presently being reassembled. "Complete" indicates that reassembly 
for the packet is complete, and the packet is waiting to be forwarded to its 
ultimate destination. "Done" indicates that the packet has been forwarded to its 
ultimate destination. The system examines packet size 512 in order to allocate 

25 sufficient space within IP buffer 223 for IP packet 510. Note that IP packet 520 
similarly contains status 521 and size 522. 
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Complete packet pointers 540 is a circular buffer containing packets that 
have been completed within IP buffer 223 and are waiting to the read out of IP 
buffer 223 in order to be forwarded to their ultimate destination. This circular 
buffer includes a pointer for reading (PR) 541 and a pointer for writing (PW) 542. 
5 PR 541 indicates which packet is to be read out of IP buffer 223 next, and PW 
542 indicates a location within the circular buffer to be written to next. If PR 541 
equals PW 542, there are no complete packets to be read out of IP buffer 223. 

Note that pointers are stored into the circular buffer in the order in which 
they are completed. Hence, a packet that is completed first within IP buffer 223 
1 0 will be read out of IP buffer 223 before a packet that was started first but 
completed later. 

Working pointers 550 includes an entry for each PID. Each entry includes 
a pointer to the beginning of the associated packet within IP packet buffer 223, as 
well as the number of bytes received so far and an active flag, which indicates 

1 5 whether the entry is active. For example, the entry for PID 1 00 includes pointer 
Wl 514, which points to the start of IP packet 510 in IP buffer 223 as well as a 
number of bytes received 553. Logic 560, which is permanently attached to each 
working pointer, produces write pointer 558, which is used to write data to the 
associated packet in IP packet buffer 223. Note that PID 102 similarly has a 

20 pointer W2 524 and a number of bytes received 554. Moreover, PID 56 1 also has 
a pointer WN 556 and a number of bytes received 555. 

Circular Buffer Operation 

FIG. 6 illustrates operation of the circular buffer for IP packets 223 in 
25 accordance with an embodiment of the present invention. When a first section of 
new IP packet is received as part of a transport packet, the packet size contained 
int the IP packet header is used to determine how much space is to be allocated for 

14 

Attorney Docket No. B2COO-0001 Inventors: Cardoso 

ARPWPORSCHBMY DOCUMENTS\B2C2\B2C00-0001\B2C00-0001 APPLICATION DOC 



the packet. This is done by adding the packet size to WC 53 1 to produce WF 532. 
If WF 532 exceeds read pointer RC 530, an overflow condition may arise. This 
is described in more detail with reference to FIG. 7 below. 



5 Process of Reconstructing IP Packets 

FIG. 7 is a flow chart illustrating the process of reconstructing IP packets 
from transport packets in accordance with an embodiment of the present 
invention. The system starts by receiving a beginning section of a new IP packet 
as part of a transport packet (step 702). The system first attempts to allocate 
1 0 additional space for the new IP packet within IP buffer 223 by adding the packet 
size to WC 531 to calculate a new WF 532 (step 704). 

The system next determines if an overflow exists by testing to see of WF 
532 has passed RC 530 within the circular IP buffer 223 (step 706). 

If an overflow exists, the system reads the status of the packet pointed to 
15 by RC 530 (step 708). If the status is "done" or "working", the old packet pointed 
to by RC 530 is discarded (step 712). This assumes that a packet that has a 
"working" status and has not been completed is missing a section and will never 
be completed unless a retry takes place. If the status is "complete", RC 530 points 
to a complete packet that is waiting to be forwarded. In this case, the incoming 
20 packet is discarded (step 711). 

If at step 706, an overflow condition does not exist, normal packet 
processing takes place. Space for the new packet is first allocated within IP buffer 
223 (step 714). A pointer to this new packet is then stored for the associated PID 
within working pointers 550 (step 715). Also, WC 513 is advanced by setting to 
25 WF 532 (step 716). 

Finally, the data for the new packet is received in subsequent transport 
packets (step 718). If all bytes are received, the pointer for the packet is moved to 
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the next location in circular order (which is pointer to by PW 542) within 
complete packet pointers 540, and PW 542 is incremented. The status field of the 
packet within IP buffer 223 is also changed to complete (step 720). 



5 Process of Reading out IP Packets 

FIG. 8 is a flow chart illustrating the process of reading IP packets from IP 
packet buffer 223 in accordance with an embodiment of the present invention. 
The system continually compares PW 542 and PR 541 (step 802). If PW 542 
equals PR 541, then the system returns to state 802 to compare again, 

1 0 If PW 542 does not equal PR 541 5 then there are complete packets waiting 

to be read out of IP buffer 223. In this case the system reads the next packet 
within the circular buffer containing complete pointers 540. This packet is 
pointed to by PR 541 (step 806). Next, the system changes the status of the 
packet within IP buffer 223 to "done" (step 810). Finally, the system advances 

1 5 RC 514 to point to the next entry in complete packet pointers 540 (step 812). In 
this way, IP packets are read out of IP buffer 223 in the order in which they are 
completed. 

The foregoing descriptions of embodiments of the present invention have 
been presented for purposes of illustration and description only. They are not 
20 intended to be exhaustive or to limit the present invention to the forms disclosed. 
Accordingly, many modifications and variations will be apparent to practitioners 
skilled in the art. Additionally, the above disclosure is not intended to limit the 
present invention. The scope of the present invention is defined by the appended 
claims. 
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